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Abstract 

Background: People want to be well informed and ask for more information regarding their health. The public can 
use different sources (i.e. the Internet, health care providers, friends, family, television, radio, and newspapers) to 
access information about their health. Insight into the types and sources of vaccine related information that parents 
use, and reasons why they seek extra information is needed to improve the existing information supply about 
childhood vaccinations. 

Methods: Dutch parents with one or more children aged 0-4 years received an online questionnaire (N =4000) 
measuring psychosocial determinants of information-seeking behaviour and self-reports of types and sources of 
vaccine information searched for (response rate 14.8%). We also tested two invitation approaches (i.e., reply card 
versus Internet link in invitation letter) to observe the difference in response rate. 

Results: Almost half of the parents (45.8%) searched for extra information. Of all the respondents, 1 3% indicated 
they had missed some information, particularly about side effects of vaccines (25%). Intention to search for 
vaccination information was influenced by positive attitude and perceived social norm towards information-seeking 
behaviour. There was no difference in the response rate between the two invitation approaches. 

Conclusions: The information provided by the National Immunization Programme (NIP) might be sufficient for 
most parents. However, some parents mentioned that they did not receive enough information about side effects 
of vaccinations, which was also the topic most searched for by parents. Public Health Institutes (PHIs) and child 
healthcare workers should therefore be aware of the importance to mention this aspect in their communication 
(materials) towards parents. The PHIs must ensure that their website is easy to find with different search strategies. 
Since the child healthcare worker is perceived as the most reliable information source, they should be aware of 
their role in educating parents about the NIP. 

Keywords: Information seeking, Information need, Internet, Reasoned action approach, Health communication, 
Vaccination 



Background 

Nowadays, individuals take an active role in managing 
their own health. People want to be well informed and 
ask for more information regarding their health [1]. The 
public can use different sources (i.e. the Internet, health 
care providers, friends, family, television, radio and 
newspapers) to access information about their health 
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[2-7]. Although physicians remain the most highly 
trusted information sources [8], the use, popularity and 
perceived importance of the Internet to get health infor- 
mation is rising [9] . Advantages of the use of Internet to 
search for information are the widespread access, ano- 
nymity, social support, and the ability to tailor informa- 
tion to one's needs [10]. Another advantage might be the 
large amount of available information. However, this also 
might be a disadvantage because of the difficulty to 
understand all the provided information and to know 
what information is objective and trustworthy [11,12]. 
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Childhood vaccination is a health topic that is highly 
searched [13,14]. Most parents (79.6%) use 2 to 6 
sources when searching for information about childhood 
vaccination [15]. Different studies have shown that 
healthcare providers are perceived as the most common 
and trusted sources of vaccine related information 
[16,17]. Jones et al. (2012) [15] and Downs et al. (2008) 
[12] showed that when parents did not view their child 
healthcare provider as a reliable source of information, 
they were more likely to obtain information about vac- 
cination through the Internet with the help of search 
engines [18]. The use of Internet to search for vaccine 
related information was clearly visible during the pan- 
demic influenza outbreak in 2009 in the Netherlands, 
when 56% of the acceptors of H1N1 influenza vaccine 
and 75% of decliners of the H1N1 vaccine searched for 
information on the Internet [19]. Bults et al. [19] showed 
that 22% of the vaccine acceptors and 25% of the vac- 
cine decliners visited Internet sites that were critical of 
vaccination. Anti-vaccination messages are more wide- 
spread on the Internet than in other media [20]. These 
anti-vaccination messages might negatively influence 
parents' vaccination decisions [21,22]. Lehman et al. 
(2013) [23] showed that social media more critically 
evaluated (influenza) vaccination information than news 
media. 

Some parents feel under informed and report a lack of 
vaccine-related knowledge [24,25]. Hak et al. (2005) [26] 
showed that among Dutch parents, 89% want an im- 
provement of the current vaccination education, and 
that they would like to be educated by health care 
workers. In the Netherlands, parents receive oral infor- 
mation about the National Immunization Programme 
(NIP) when a nurse of the child welfare centre visits the 
parents at their home when their infant is about two 
weeks old. When the child is 4-6 weeks old, parents re- 
ceive through surface mail a brochure with information 
about vaccines, diseases, the vaccination schedule, side 
effects, and with a reference to the website of the 
National Institute of Public Health and the Environment 
(RIVM). When children are 8 weeks old, they will get 
their first vaccination at the child welfare centre, where 
they also receive health check-ups. In the Netherlands, 
the NIP is managed by the RIVM, is voluntary and free 
of charge, with an overall coverage of 95% in 2012 [27]. 

So far, no systematic research has been done in the 
Netherlands about parental information-seeking beha- 
viour in childhood vaccinations. We therefore conducted 
a quantitative study to get more insight in parents' infor- 
mation seeking behaviour about the NIP and in their in- 
formation need. Insight into topics and sources of 
vaccine related information that parents use, and reasons 
why they seek extra information is needed to improve 
existing information supply about the NIP. In particular, 



we would like to get more insight in the psychosocial de- 
terminants that influence the intention of parents to 
search for information about the NIP. Insight in these 
determinants might be useful to explore the drivers of 
parents to search for information. 

We also tested in this study two invitation approaches 
to observe the difference in response rate. Research 
showed that different invitation approaches resulted in 
different response rates. A systematic review of Edwards 
et al. (2002) [28] showed that when surveys were sent by 
recorded delivery, when stamped return envelopes were 
used, participants were contacted before sending ques- 
tionnaires, and when a reminder was used, response was 
more likely. Since we had used an online questionnaire, 
we were interested in what kind of invitation method 
was most effective: sending an invitation letter with a 
reply card where parents could fill in their e-mail ad- 
dress and then received an e-mail with an Internet link 
to access the questionnaire, or an invitation letter with 
an Internet link to the questionnaire. 

Theoretical framework 

To study the psychosocial determinants that influence pa- 
rents' intention to seek information about childhood vac- 
cination, we used the Reasoned Action Approach (RAA) 
of Fishbein and Ajzen (2010) [29], which is the most re- 
cent formulation of the Theory of Planned Behaviour 
(TPB) [30]. The TPB is a well-founded theory and often 
used in health behaviour research [31-33] and in informa- 
tion seeking behaviour studies [34-37]. 

The RAA indicates that intention, the desire to perform 
certain behaviour, is determined by attitude towards the 
behaviour, perceived norm, and perceived behavioural 
control. Attitude is a positive or negative evaluation of the 
behaviour. Perceived norm is the perceived social pressure 
to perform (or not to perform) a behaviour. Perceived be- 
havioural control is an assessment of the individual's con- 
fidence in being able to perform the behaviour [29]. The 
direct measures attitude, perceived norm and perceived 
control are determined in turn by behavioural, normative 
and control beliefs. These beliefs constitute specific expec- 
tations about the outcomes of the behaviour, anticipated 
support from significant others, and barriers and facilita- 
tors to perform the behaviour. 

Behavioural beliefs (i.e., behavioural belief strength and 
outcome evaluation) are the indirect measures of atti- 
tude and are beliefs of an individual about the outcome 
of performing a particular behaviour. Normative beliefs 
(i.e. injunctive normative beliefs and descriptive norma- 
tive beliefs) are the indirect measures of perceived norm. 
The injunctive normative beliefs include injunctive nor- 
mative belief strength and motivation to comply, which 
refers to beliefs that particular referents approve or not 
approve behaviour. The descriptive normative beliefs 
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include the descriptive normative belief strength and the 
identification with the referent. These descriptive nor- 
mative beliefs refer to a belief of an individual that a 
particular referent will perform or not perform the be- 
haviour. Control beliefs (i.e. the power of control and 
control belief strength) are indirect measures for per- 
ceived control. These beliefs refer to particular factors 
that could facilitate or impede performance of the be- 
haviour [29]. 

Methods 

Design & procedure 

This cross-sectional study design by means of an online 
self-reported questionnaire were offered to a sample of 
4000 parents who lived in the Netherlands, with at least one 
child aged 0-4 years, randomly selected from Praeventis, 
the national database for vaccination registration [38]. 

Two invitation approaches were used and parents were 
randomly assigned to one of those two. In one approach, 
parents received an invitation letter regarding the study 
objectives and procedures, and could inform the re- 
searchers whether they wished to participate by sending 
a reply-card with their e-mail address. Parents who did 
so then received an e-mail with an Internet link to ac- 
cess the questionnaire. The other approach consisted of 
the same invitation letter, with an Internet link. Parents 
could type the Internet link in their web browser to get 
direct access to the questionnaire. The aim of these two 
invitation approaches was to evaluate which resulted in 
the highest response rate. After three weeks, reminder 
letters with the Internet link to the questionnaire were 
sent to all of the 4000 parents. Participants were assured 
of their privacy and confidentiality of their responses in 
the invitation letter and at the start of the questionnaire. 
Those who participated gave their informed consent by 
filling out the questionnaire. This study was approved by 
the Maastricht University's Ethics Research Board. 

Questionnaire 

The demographic variables gender, age, country of birth, 
education, household income, number of children in the 
family and self-reported vaccination status of the children 
were measured with appropriate items. The other items 
were based on 7-point Likert scales with the end-points 
labelled as 1 = totally disagree and 7 = totally agree. Items 
were averaged into one single concept when they showed 
sufficient internal consistency (Cronbachs alpha a > .60 or 
Pearson correlation coefficient r > .50 with two items). 
Evaluation of the personal experience with the NIP was 
measured with one item (i.e., 'How is your general experi- 
ence with the NIP?' "Very bad-very good'). Two items 
measured consideration: whether immunization of the 
child is perceived as self-evident, and the amount of 
thought given to the process of vaccination decision 



making (i.e., 'Vaccinating my child is self-evident' and 
'I don't have to think long about vaccinating my child.', 
'Totally disagree - totally agree'; r = .75). Attitude towards 
the NIP was measured with three semantic differentials 
(i.e. 'I think the NIP is ... very bad - very good'; 'very 
unimportant - very important'; 'very unreliable - very 
reliable'; a = .88). 

To get insight in the information need of parents 
about the NIP, parents were asked multiple-choice ques- 
tions at what time, from whom and how they would like 
to receive information and if they missed any informa- 
tion about the NIP. Parents were also asked if they have 
searched for information about the NIP in the past 
(yes-no question). Only parents who indicated they had 
already searched for information got access to the last 
part of the questionnaire. This part consisted of multiple 
choice questions about where and when parents had 
searched for information, which information sources 
they had used, and whether these information sources 
had influenced their choice to vaccinate and their opi- 
nion about the NIP (self-reported). 

The psychosocial determinants of information seeking 
were based on 7-point Likert scales with the end-points 
labelled as 1 = totally disagree and 7 = totally agree. 
Intention was measured with three items (i.e., 'I expect 
that I will search for information about the NIP in the 
future', 'I intend to search for information about the NIP 
in the future', 'It is likely that I will search for information 
about the NIP in the future'; a = .94). Attitude was mea- 
sured by three semantic differentials (i.e., 'Information 
seeking about the NIP, I think is... very bad-very good'; 
'very unwise-very wise'; 'very unimportant-very impor- 
tant'; a = .83). Perceived norm was measured with three 
items (i.e., 'Most people around me think I should search 
for information about the NIP'; 'Most people who are im- 
portant to me think I should search for information about 
the NIP', 'Most people similar to me think I should search 
information about the NIP'; a = .86). Perceived control 
was measured by three items (i.e., 'I can judge what reliable 
information about vaccinations is', After reading all the 
pros and cons about vaccinations, I can choose whether or 
not I will vaccinate my child', 'I can find the information 
that I am searching for'; a = .85). Table 1 shows the items 
of the indirect measures of the RAA. 

Data-analysis 

To analyse the data, IBM SPSS Statistics version 19.0 was 
used. Descriptive analysis was used to summarize the 
demographic characteristics. To find out if gender, age, 
country of birth, and education were related to intention 
to seek information, i-tests, Pearson correlation coef- 
ficients and One- Way ANOVA's were conducted. The 
bivariate associations between the psychosocial measures 



Harmsen et al. BMC Public Health 2013, 13:1219 
http://www.biomedcentral.eom/1471-2458/1 3/1219 



Page 4 of 10 



Table 1 Difference between the beliefs of high and low intenders beliefs, based on a median split of intention 



Indirect measures 


Items 


Low Intenders 
(n = 338) M (SD) 


High Intenders 
(n = 254) M (SD) 


p- value 


Behavioural belief 
strength 


- Finding information about the NIP increases 
my knowledge 


4.84 


(1.53) 


4.97 


(1.05) 


.35 




- By searching for information about the NIP, it will 
be more easy for me to make a choice whether 
to vaccinate my child or not 


3.99 


(1.69) 


4.49 


(1.31) 


<.01 




- By searching for information about the NIP, 1 will be 
more easy for me to talk with others about vaccination 


4.25 


(1.70) 


4.51 


(1.09) 


.11 


Outcome evaluation 


- Making a choice about whether or not to vaccinate my 
child, 1 think is.Very bad - Very good 


4.85 


(1.57) 


5.27 


(1.39) 


<.01 




- Increasing knowledge about the NIP, 1 think is... 
Very bad - Very good 


4.87 


(0.95) 


5.13 


(0.99) 


.02 




- Talking about the NIP with others, 1 think is... Very bad - Very good 


4.55 


(1.06) 


4.95 


(0.97) 


<.001 


Injunctive normative 
belief 


- My friends think 1 should search for information about the NIP 

- My family think 1 should search for information about the NIP 


1.71 
1.97 


(0.85) 
(1.12) 


2.92 
2.99 


(1.13) 
(1.13) 


<.001 
<001 




ft A 1 t't 1 j-L. 1 i i |i if" ■ r . ■ 

- My general practitioner think 1 should search for information 
about the NIP 


1 .87 


(1 -06) 


2.96 


(1.12) 


<.001 




ft fi f 1 j_ j_l I'll \£ . j_ 1 ■ 1 1 1 II 

- My nurse/doctor at the child welfare centre think 1 should 
search for information about the NIP 


2.05 


(1 -26) 


3.14 


(1.25) 


<.001 




^~\j_l j_ ■ ■ "j_i I'll 

- Other parents in my environment with young children 
(0-4 years) think 1 should search for information about the NIP. 


1.90 


(1.01) 


3.01 


(1.16) 


<.001 


Descriptive normative 
belief strength 


- Most of my friends search for information about the NIP 

- Other parents in my environment with young children 
(0-4 years) search for information about the NIP 


2.15 
3.05 


(1-22) 
(1-36) 


3.16 
3.64 


(1.09) 
(1.04) 


<.001 
<.001 


Power of control 


- If 1 want, 1 know for sure that 1 am able to find information 
about the NIP 


5.90 


(1.16) 


5.69 


(1.06) 


.07 




- If 1 want, 1 have confident that 1 am able to find information 
about the NIP 


5.65 


(1.23) 


5.44 


(1.06) 


.09 




- If 1 want, 1 have enough skills to find information about the NIP 


5.78 


(1-37) 


5.54 


(1.15) 


.08' 


Control belief 


- 1 can assess what reliable information about vaccines is 


4.25 


(1.50) 


4.33 


(1.26) 


,6V 


strength 


- After reading all the pros and cons about vaccines, 1 can choose whether 
or not 1 will vaccinate my child 


4.95 


(1-60) 


4.96 


(1.35) 


.91 




- 1 can find the information that 1 am searching for 


5.35 (1.31) 


5.26 (1.12) 


.49 



Note: M = Mean, SD = Standard Deviation, scale range: 1-7. 



of information seeking behaviour were analysed with 
Pearson correlation coefficients. 

To indicate whether gender, age, country of birth, and 
education were related with parents' information need 
and information seeking behavior, a multivariate logistic 
regression analysis was performed. Descriptive analysis 
was used for the information need of parents and for 
items about the actual information seeking behaviour, 
and parents' self-reported influence from the used infor- 
mation sources on their vaccination decision and their 
opinion of the NIP. 

To show the unique contribution of variables to the 
explanation of intention and the total amount of va- 
riance explained in intention, we conducted a linear 
hierarchical regression analysis. In the first step we in- 
cluded all direct psychosocial measures of the RAA. In 
the second step we included past behaviour, general 



attitude about the NIP and consideration, and in the 
third step we included the demographic variables that 
showed significant associations with intention (p < .01). 

To analyse the contribution of the indirect measures 
in the prediction of the direct measures of the RAA, we 
conducted separate linear regression analysis for each 
direct measure. Finally, differences in the beliefs between 
participants with high and low intentions to search for 
vaccine related information were analysed. Therefore, 
the sample was divided into two groups using a median 
split on the intention measure, and analysis was done 
with independent-samples t-tests. 

Results 

Response rate 

A total of 592 out of 4000 (15%) parents completed the 
questionnaire. Of the 2000 parents who received the 



Harmsen et al. BMC Public Health 2013, 13:1219 
http://www.biomedcentral.eom/1471-2458/1 3/1219 



Page 5 of 10 



information letter with reply card, 211 (11%) returned 
the reply card, and 135 of those parents (64%; 6.8% of 
2000) completed the questionnaire. Of the other 2000 
parents who received an information letter with Internet 
link, 143 (7.2%) completed the questionnaire. Reminder 
letters with the Internet-link were sent after three weeks 
to all the 4000 parents. Before the reminder, 278 (7%) 
parents completed the questionnaire, and after the re- 
minder, another 314 (8%) parents. 

Descriptive statistics 

Of the 592 respondents, 85% were female. The mean age 
was 35 years (SD = 5.3). 92% were born in the Netherlands, 
and 54% had finished higher education or university. Half 
of the respondents (51%) had a household income above 
modal (modal gross household income per year is €32 
500 [39]). Most respondents had two children (47%) 
while 82% reported that their first child received all the 
recommended vaccinations within the NIP. 16% were 
partially vaccinated, and 2% were not vaccinated at all. 

Overall, the respondents reported a positive expe- 
rience with the NIP (M = 5.69, SD = 1.18), a positive 
general attitude towards the NIP (M = 5.81, SD = 0.89), 
and that vaccinating their child(ren) was self-evident 
(M = 5.89, SD = 1.38). A small proportion of the respon- 
dents (8.4%) indicated that religious beliefs or another 
conviction had influenced their opinion about child- 
hood vaccination. Parents who indicated this, stated 
that religion had the most influence on their opinion 
(M = 4.74, SD = 2.05). 

An independent sample £-test found no significant dif- 
ferences between males and females in their intention to 
search for information (f (590) = -1.73, p = A7), and no 
significant difference whether parents were born in the 
Netherlands or not (t (592) = -0.38, p = .71). Age (r = -.02, 
p = .49) and educational level (F (18, 573) = 1.02, p = .43) 
were also not significantly related with intention to search 
for information. 

Information need of the parents 

A logistic regression analysis showed that parents who 
were born in the Netherlands had a higher need for in- 
formation than those who were born in another country 
(OR = 0.42, 95% CI: 0.22 - 0.81). All the other demo- 
graphic variables (i.e., age (OR = 0.98, 95% CI: 0.94 - 
1.03), gender (OR = 1.55, 95% CI: 0.81 - 2.96), education 
level (OR = 1.14, 95% CI: 0.98 - 1.32)) showed no signifi- 
cant influence to parents' information need. 

Overall, parents indicated that they would like to re- 
ceive information about the NIP after birth, but before 
the first vaccination of their child. Most parents (33%) 
thought the child welfare centre was the most reliable 
source to provide information about childhood vac- 
cination, followed by the general practitioner (29%), and 



the RIVM (22%). Parents would like to receive the infor- 
mation in a brochure (63%) or by a letter (55%). 

Of all the parents, 13% (n = 79) indicated that they did 
not receive enough information from the RIVM about 
the NIP. Of the parents who had missed information, 
most of them would like to receive more information 
about possible negative consequences of vaccines (25%) 
and side effects of vaccines (18%). Other topics parents 
would like to receive more information about were: the 
components of the vaccines (10%), reasons for including 
vaccines in the programme (7%), and counter indications 
for vaccination when, for example, the child is sick or 
has a chronic disease (6%). 

Information seeking behaviour 

A logistic regression analysis showed that parents who 
were born in the Netherlands were more likely to search 
for information than those who were born in another 
country (OR = 0.31, 95% CI: 0.16 - 0.59). Also higher edu- 
cated parents (OR = 1.23, 95% CI: 1.10 - 1.38) and parents 
with an older age (OR = 1.04, 95% CI: 1.00 - 1.08) were 
more likely to search for information. Gender (OR = 1.38, 
95% CI: 0.83 - 2.30) had no significant influence to pa- 
rents' information seeking behaviour. 

Almost half of the respondents (n = 271, 46%) searched 
for information about the NIP. More than a third (36%) 
of the parents started to search for information after the 
birth of their child and before the first vaccination, 
followed by 24% of the parents who started to search for 
information between the vaccination rounds in the NIP. 
The most common topics that parents searched for 
were: side effects (82%), vaccines (60%), diseases (56%), 
and the vaccination schedule (51%). Parents reported 
that when they found information about the NIP they 
looked for, they did not search for more NIP related in- 
formation again (M = 3.75, SD = 1.56). 

The information sources that parents used most were: 
the Internet (41%), the doctor (26%) and nurse (23%) of 
the child welfare centre, their family (21%) and friends 
(18%). Among the parents who used the Internet, the 
website of the RIVM was the most used Internet site 
(49%), followed by Google and other search engines 
(29%). Some parents (8%) visited the Internet site of the 
association of critical vaccination in the Netherlands. 
Parents who used the website of the RIVM reported that 
the website had almost no influence on their choice 
to vaccinate or not (M = 3.17, SD = 1.63), and a small 
influence on their opinion about the NIP (M = 3.84, 
SD = 1.56). Parents who consulted the doctor and/or the 
nurse at the child welfare centre reported that these 
health care workers had a small influence on their 
choice to vaccinate or not (doctor: M = 3.52, SD = 1.75; 
nurse: M = 3.64, SD = 1.73) and on their opinion about 
the NIP (doctor: M = 3.68, SD = 1.79; nurse: M = 3.90, 
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SD = 1.73). Family and friends were also perceived as not 
having a big influence on parents' choice to vaccinate 
their child or not (family: M = 4.31, SD = 1.76; friends: 
M = 3.75, SD = 1.64), and on their opinion about the 
NIP (family: M = 4.19, SD = 1.78; friends: M = 3.69, 
SD = 1.60). Parents indicated that the information they 
found was complete (M = 4.91, SD = 1.38) and gave an 
answer to their questions (M = 4.98, SD = 1.40). 

Direct and indirect measures of intention to search for 
information 

Table 2 shows the means, standard deviations (SD) and 
Pearson correlations for the direct measures of the RAA. 
Parents had a positive attitude towards information 
seeking about the NIP (M = 5.23, SD = 0.90), and per- 
ceived a weak pressure from their social environment to 
search for information (M = 3.18, SD = 1.33). Parents be- 
lieved they were able to search for information about the 
NIP (M = 5.72, SD = 1.05). 

To get insight in the strength of the association among 
the direct measures and intention, Pearson correlation 
were calculated. In terms of effect sizes, small associa- 
tions are correlations with r between .10 and .23; a cor- 
relation between .24 and .36 shows a moderate effect, 
and a correlation of r > .37 indicates a large association 
[40]. The direct measures attitude and perceived norm 
showed a strong positive association with intention to 
search for information about the NIP (see Table 2). 

Table 3 shows the results of the linear hierarchical re- 
gression of intention on the direct measures. The demo- 
graphic variables gender, age and educational level were 
not significantly related with intention to search for 
information, and were therefore not included in the 
regression analysis. The first column shows the regres- 
sion with all the direct RAA measures. Attitude and 
perceived norm are the most powerful significant pre- 
dictors of intention to search for information about the 
NIP. The direct measures of the RAA explained 34% of 
the variance in intention to search for information 
about the NIP (R =. 34). Adding past behaviour, general 
attitude about the NIP, and considerations about the 



Table 2 Correlation matrix and mean scores (SD) of direct 
measures of the RAA 





1. 


2. 


3. 4. 


1. Intention 








2. Attitude 


.44* 






3. Perceived norm 


.51* 


.38* 




4. Perceived control 


04 n. S . 


.16* 


-,04 ni 


Mean score 


3.92 


5.23 


3.18 5.72 


SD 


1.5 


0.8 


1.3 1.0 



Note: * p < .001, n.s. = not significant, scale range: 1-7, SD = Standard Deviation. 



choice to vaccinate in the second step showed a negative 
significant contribution of general attitude about the 
NIP, and a positive significant contribution of past 
behaviour (whether parents already searched for infor- 
mation about the NIP) at intention. The amount of 
thought given to the choice to vaccinate or not (consi- 
deration) was not significantly associated to parents' 
intention to search for NIP information, while attitude 
and perceived norm remained significant. By including 
these measures, the explained variance increased to 36% 
{R 2 = .36). 

Table 4 shows the linear regression analysis of the dir- 
ect measures on the related indirect measures of the 
RAA. Finding information to increase knowledge was 
positively associated with parents' attitude to search for 
information. The belief that increasing knowledge about 
the NIP is good, and that talking about the NIP with 
others is good, was also positively associated with par- 
ents' attitude. The behavioural beliefs explained 55% 
(IT = .55) of the variance in attitude to search for NIP 
information. The belief that friends, family, the general 
practitioner, and other parents, think that they should 
search NIP information was positively associated with 
perceived norm. Also, the belief that other parents and 
friends search for NIP information themselves was posi- 
tively associated with the direct measure perceived 
norm. The normative beliefs explained 85% (R 2 = .85) of 
the variance in perceived norm to search for NIP infor- 
mation. One item of the control beliefs: 'If I want, I am 
confident that I am able to find information about the 
NIP' was excluded from the regression analysis because 
of multi-collinearity. The other control beliefs: having 
enough skills, and being able to find the wanted infor- 
mation, were positively associated with perceived con- 
trol. The control beliefs explained 95% (R 2 = .95) of 
the variance in perceived control to search for NIP 
information. 

Differences in beliefs between high and low intenders 

To determine differences in beliefs between those with 
higher and lower intention to search for vaccine related 
information, the sample was divided into two groups 
based on a median split in the intention distribution 
(median = 4.0), which is presented in Table 1. Parents 
with a high intention seem to have stronger beliefs that 
searching for vaccine related information will make it 
easier to make a decision whether to vaccinate their 
child or not. Parents with a high intention also felt 
a higher social pressure of their social environment 
(friends, family, general practitioner, nurse/doctor child 
welfare centre) to search for information. Parents with 
low and high intentions both felt confident to search for 
information and thought that they were able to find the 
information they were searching for. 
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Table 3 Linear hierarchical regression analyses of intention on the direct measures of RAA, past information-seeking 
behaviour, NIP attitude, and considerations 





r 


b 


SE 


p-value 


b 


SE 


p-Value 


Attitude information seeking 


44* 


0.49 


.06 


.00 


0.42 


.07 


<.001 


Perceived norm 


.51* 


0.46 


.04 


.00 


0.40 


.04 


<.001 


Perceived control 


.04* 


0.02 


.05 


.66 


0.05 


.05 


.27 


Past information-seeking behaviour 


.29* 








0.42 


.11 


<.001 


NIP attitude 


-,07 ns - 








-0.17 


.08 


.03 


Considerations about choice to vaccinate 


-.12* 








0.02 


.05 


.62 


R 2 




.34 






.36 




<.001 


AR 2 










.03 







Note: b = unstandardized regression coefficient, SE = Standard Error, R 2 = explained variance. 
*p < 0.001, n.s. = not significant. 



Discussion 

This study shows that most parents believe that health 
care workers at child welfare centers are the most reliable 
source to provide information about the NIP, which is in 
line with previous research [16,41-43]. Parents would like 
to receive information that is presented in a brochure or 
folder, which is not in line with a study of Hak et al. 
(2005) [26], who showed that Dutch parents preferred to 
be educated by health care workers. Downs et al. (2008) 
[12] showed that parents often feel under-informed and 
lack relevant vaccination knowledge, which is not com- 
pletely in line with this study, where only 13% of the re- 
spondents reported not receiving enough information, 
mainly about side effects and possible negative con- 
sequences of childhood vaccination. It seems that the in- 
formation provided by the RIVM is sufficient for most of 
the parents. 

Although a small amount of the parents indicated to 
have a need for information, almost half of the respon- 
dents (46%) searched for information about the NIP. This 
is less than the amount of Dutch parents that searched for 
information during the H1N1 pandemic in 2009 (76% of 
vaccine decliners and 56% of vaccine acceptors) [19]. The 
difference might be caused because the H1N1 was a pan- 
demic with a lot of media attention. Parents perceived 
health care workers as the most reliable source of vaccine 
related information, but they used the Internet most of 
the time to search for information, which is also shown in 
a study of Downs et al. (2008) [12]. This study shows that 
the information parents searched for most of the time 
(side effects and possible negative outcomes of vaccin- 
ation) was the same information they missed from the 
Public Health Institute (PHI), despite the fact that side ef- 
fects is a topic that is mentioned in the education material 
by the PHI in the Netherlands. It might be that the infor- 
mation provided by the PHI about side effects is not 
enough, or that parents do not read the material well 
enough and therefore feel under informed. PHIs should 
therefore try to improve their communication (materials) 



about childhood vaccination by including more or other 
information about side effects, and possible negative con- 
sequences of childhood vaccination. Healthcare workers 
should also be aware of the information need of parents, 
and try to educate them about side effects when parents 
visit the child healthcare centre. 

To get insight into the drivers that influence parents' 
intention to search for vaccine related information, we 
used the Reasoned Action Approach (RAA) of Fishbein 
and Ajzen (2010) [29]. The measures of the RAA ex- 
plained 34% of the variance in intention, which is some- 
what lower than the average of 41% that was found in a 
review of the TPB by Godin and Kok (1996) [44]. Al- 
though the RAA seems to be a useful theory to explore 
drivers for vaccine related information seeking beha- 
viour, other factors like: perceived hazard characteristics, 
affective response to risk, information sufficiency and 
someone's personal capacity to learn, which are part of 
the Risk Information Seeking and Processing (RISP) 
model of Griffin et al. [45], might increase the explained 
variance of intention by psychosocial determinants. 

Overall, parents had a positive attitude towards informa- 
tion seeking about the NIP and perceived a low influence 
of their social environment to search for information. 
Although parents reported a low social pressure to search 
for information, parents' social environment seems to have 
a significant influence on the intention to search for infor- 
mation, which is in line with a study of Clarke et al. (2012) 
[34]. Searching for information may be driven by people's 
social environment, because sharing information may con- 
tribute to the feeling of belonging to a group [46] . 

This study showed that highly educated parents searched 
for more information and when parents were more nega- 
tive about the NIP, they were more likely to search for 
information. Parents indicated that the information they 
found did not have a big influence at their attitude or 
intention to vaccinate or not. Although parents indicated 
that the information they found did not have a big in- 
fluence, Betsch et al. (2010) [22] showed in an experiment 
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Table 4 Linear regression analyses of direct RAA 
measures on the related indirect RAA measures 



Attitude 



Behavioural belief strength 


b 


S.E. 


p-value 


Finding information about the NIP increases my 
knowledge 


0.15 


.03 


<.001 


By searching for information about the NIP, it 
will be more easy for me to make a choice 
whether to vaccinate my child or not 


0.05 


.02 


.03 


By searching for information about the NIP, 
wi be more easy for me to ta k with others 
about vaccination 


0.00 


.03 


.90 


Making a choice about whether or not to 
vaccinate my child, I think is.Very bad-Very good 


0.02 


.02 


.33 


ncreasing knowledge about the NIP, I think is. . . 
Very bad - Very good 


0.41 


.03 


<001 


Talking about the NIP with others, I think is... 
Very bad - Very good 


0.16 


.03 


<001 


R 2 


.55 








Perceived norm 


Normative beliefs 


b 


S.E. 


p-Value 


My friends think I shou d search for information 
about the NIP 


0.08 


.03 


<.05 


My family think I should search for information 
about the NIP 


0.43 


.03 


<.001 


My general practitioner think I should search for 

information ^hnuf thp NIP 

IIIUIIIIQUUII QUUUl 11 IC iNir 


0.08 


.03 


<.01 


My nurse/doctor at the child welfare centre 
think 1 should search for information about the 
NIP 


0.00 


.02 


.99 


Other parents in my environment with young 
children (0-4 years) think 1 should search for 
information about the NIP 


0.16 


.03 


<.001 


Most of my friends search for information about 
the NIP 


0.09 


.02 


<.001 


Other parents in my environment with young 
children (0-4 years) search for information 
about the NIP 


0.12 


.02 


<.001 


R 2 


.85 








Perceived control 


Control beliefs 


b 


S.E. 


p-value 


If 1 want, 1 know for sure that 1 am able to find 
information about the NIP 


0.01 


0.02 


.47 


If 1 want, 1 have enough skills to find 
information about the NIP 


0.43 


0.01 


<.001 


can assess what reliable information about 
vaccines is 


-0.00 


0.01 


.62 


After reading all the pros and cons about 
vaccines, 1 can choose whether or not 1 will 
vaccinate my child 


0.02 


0.01 


.05 


1 can find the information that 1 am searching 
for 


0.10 


0.01 


<.001 


R 2 


.95 







Note: b = unstandardized regression coefficient, SE = Standard Error, 
Ft 2 = explained variance. 



that searching for information might turn out to have a 
negative influence at parents' perceptions and intention to 
vaccinate, especially when they visit vaccine-critical web- 
sites. A study in the US [47] showed that when parents 
search for vaccine related information, out of the 30 sites, 
21 were immunisation sites, and 5 of them were classified 
as anti-vaccination. In addition, Wolfe & Sharp (2005) 
[48] showed that a search on the word "vaccination" pro- 
duced more anti-vaccination than pro-vaccination web- 
sites. When parents use less specific search terms, they 
were more likely to find vaccine critical websites [12]. To 
prevent parents from visiting vaccine-critical websites, 
Public Health Institutes should be aware of parents infor- 
mation need, try to fulfil this need by improving their 
communication materials, and assure that their websites 
are easy to find, even when parents use negative search 
terms about the NIP. The PHI could also communicate to 
parents where to find reliable information about child- 
hood vaccination. 

Another aim of our study was to investigate two diffe- 
rent invitation approaches (i.e., reply card versus Inter- 
net link in invitation letter) to test the difference in 
response rate. The parents who received a reply card 
had a higher response (11%), but not all parents com- 
pleted the questionnaire, so at the end, the response rate 
of the two different approaches was the same (7%). The 
information letter with the link to the questionnaire is 
the preferred method, because this is a more time effi- 
cient approach compared to reply cards. When time is 
not an issue, more effort could be done to include all 
the parents who returned the reply card and did not 
complete the questionnaire to get a higher response rate. 
In this study, the response rate was doubled after sen- 
ding a reminder. The positive effect of a reminder is also 
shown in other studies [28,49]. We therefore recom- 
mend to use a reminder when sending out (online) 
questionnaires. 

This study also has several limitations. First of all, 
there might be response bias, because the results of this 
study are based on an overall questionnaire response 
rate of 15%. Unfortunately no further data was available 
to compare participating parents with non-participating 
parents. A second limitation might be that although in 
the Netherlands 96% of all 12 to 75 year-olds use the 
internet, [50] only those who had access to the Internet 
could complete the questionnaire. 

Conclusions 

Only 13% of the respondents searched for extra informa- 
tion about the NIP, so the information provided by the 
NIP might be sufficient for most parents. However, some 
parents mentioned that they did not receive enough in- 
formation about side effects of vaccinations. PHIs and 
child healthcare workers should therefore be aware of 
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the importance to mention this aspect in their communi- 
cation (materials) towards parents. Because most parents 
used the search engine on the internet to get vaccine re- 
lated information, the PHI must ensure that their website 
is easy to find with different search strategies. This study 
also showed that parents who were more negative about 
the NIP were more likely to search for information about 
the NIP which might result in more negative attitudes be- 
cause of the chance of visiting anti-vaccination websites. 
Listening carefully to the needs of parents who are more 
negative about the NIP and trying to fulfill their informa- 
tion need with reliable sources is therefore important. Be- 
cause the child healthcare worker is perceived as the most 
reliable information source, they should be aware of their 
role in educating parents about the NIP. 

Competing interests 

The authors declare that they have no competing interests. 
Authors' contributions 

All authors discussed the study design and research instrument. IH and GD 
prepared the questionnaire and performed the data collection and data 
analysis. IH wrote the first version of the manuscript. All authors contributed 
to the draft of the final manuscript; their remarks were discussed and 
processed into the final version that was finally approved by all authors. All 
authors read and approved the final manuscript. 

Acknowledgements 

We would like to thank Reuben Gready for the editorial review. 
Author details 

'National Institute for Public Health and the Environment (RIVM), Centre for 
Infectious Disease Control, P.O. Box 1 3720, BA, Bilthoven, the Netherlands, 
department of Work & Social Psychology, Maastricht University, Maastricht, 
the Netherlands, department of Earth and Life Sciences, VU University of 
Amsterdam, Amsterdam, the Netherlands. 

Received: 17 September 2013 Accepted: 16 December 2013 
Published: 21 December 2013 

References 

1 . Rains SA: Perceptions of traditional information sources and use of the 
world wide web to seek health information: findings from the health 
information national trends survey. J Health Commun 2007, 12:667-680. 

2. Anderson JG: Consumers of e-health: patterns of use and barriers. 

Soc Sci Comput Rev 2004, 22:242-248. 

3. Brashers DE, Goldsmith DJ, Hsieh E: Information seeking and avoiding in 
health contexts. Hum Commun Res 2002, 28:258-271. 

4. Dolan G, Iredale R, Williams R, Ameen J: Consumer use of the internet for 
health information: a survey of primary care patients. Int J Consum Stud 
2004,28:147-153. 

5. Johnson JD, Meischke H: A comprehensive model of cancer-related 
information seeking applied to magazines. Hum Commun Res 1993, 

19:343-367. 

6. Kivits J: Researching the informed patient. Inf Commun Soc 2004, 
7:510-530. 

7. Napoli PM: Consumer use of medical information from electronic and 
paper media: literature review. In The internet and health communication; 
experience and expectations. Edited by Rice RE, Katz JE. Thousand Oaks, 
CA: Sage; 2012:79-98. 

8. Hesse BW, Nelson DW, Kreps GL, Croyle RT, Arora NK, Rimer BK, Viswanath K: 
Trust and sources of health. The impact of the Internet and its 
implications for health care providers: findings from the first health 
information national trends survey. Arch Intern Med 2005, 165:2618-2624. 

9. Kummervold PE, Chronaki CE, Lausen B, Prokosch HU, Rasmussen J, Santana S, 
Staniszewski A, Wangberg SC: eHealth trends in Europe 2005-2007: a 
population-based survey. J Med Internet Res 2008, 10:42. 



10. Cline RJ, Haynes KM: Consumer health information seeking on the 
internet: the state of the art. Health Educ Res 2001, 16:671-692. 

1 1 . May T: Public communication, risk perception, and the viability of 
preventive vaccination against communicable diseases. Bioethics 2005, 

19:407-421. 

12. Downs JS, De Bruin WB, Fischhoff B: Parents' vaccination comprehension 
and decisions. Vaccine 2008, 26:1595-1607. 

13. Betsch C, Brewer NT, Brocard P, Davies P, Gaissmaier W, Haase N, Leask J, 
Renkewitz F, Renner B, Reyna VF, Rossmann C, Sachse K, Schachinger A, 
Siegrist M, Stryk M: Opportunities and challenges of Web 2.0 for 
vaccination decisions. Vaccine 2012, 30:3727-3733. 

14. Bean SJ: Emerging and continuing trends in vaccine opposition website 
content. Vaccine 201 1, 29:1874-1880. 

15. Jones AM, Omer SB, Bednarczyk RA, Halsey NA, Moulton LH, Salmon DA: 
Parents' source of vaccine information and impact on vaccine attitudes, 
beliefs, and nonmedical exemptions. Adv Prev Med 2012, 15:932741. 

1 6. Stefanoff P, Mamelund SE, Robinson M, Netterlid E, Tuells J, Riise Bergsaker MA, 
Heijbel H, Yarwood J: Tracking parental attitudes on vaccination across 
European countries: the vaccine safety, attitudes, training and 
communication project (VACSATC). Vaccine 2010, 28:5731-5737. 

17. Kennedy A, Basket M, Sheedy K: Vaccine attitudes, concerns, and 
information sources reported by parents of young children: results from 
the 2009 health styles survey. Pediatrics 201 1, 127:92-99. 

18. Madden K, Nan X, Briones R, Waks L: Sorting through search results: a 
content analysis of HPV information online. / 2012, 30:3741-3746. 

19. Bults M, Beaujean DJMA, Richardus JH, Van Steenbergen JE, Voeten HACM: 
Pandemic influenza A (HI N 1 ) vaccination in The Netherlands: parental 
reasoning underlying child vaccination choices. Vaccine 201 1, 
29:6226-6235. 

20. Davies P, Chapman S, Leask J: Antivaccination activists on the world wide 
Web. Arch Dis Child 2002, 87:22-25. 

21. Kata A: Anti-vaccine activists, Web 2.0, and the postmodern paradigm an 
overview of tactics and tropes used online by the anti-vaccination 
movement. Vaccine 201 1, 30:3778-3789. 

22. Betsch C, Renkewitz F, Betsch T, Ulshofer C: The influence of vaccine- 
critical websites on perceiving vaccination risks. J Health Psychol 2010, 
15:446-455. 

23. Lehmann BA, Ruiter RA, Kok G: A qualitative study of the coverage of 
influenza vaccination on Dutch news sites and social media websites. 

BMC Public Health 2013, 13:547. 

24. Austvoll-Dahlgren A, Helseth A: What informs parents' decision-making 
about childhood vaccinations? J Adv Nurs 2010, 66:2421-2430. 

25. Evans M, Stoddart H, Condon L, Freeman E, Grizell M, Mullen R: Parents' 
perspectives on the MMR immunization: a focus group study. 

Br J Gen Pract 2001, 51(472):904-910. 

26. Hak E, Schonbeck Y, De Melker H, Van Essen GA, Sanders EAM: Negative 
attitude of highly educated parents and health care workers towards 
future vaccinations in the Dutch childhood vaccination program. 
Vaccine 2005, 23:3103-3107. 

27. van Lier EAN, Oomen PJ, Conyn-van Spaenendonck MAE, Drijfhout IH, 

de Hoogh PAAM, de Melker HE: Vaccination coverage national immunisation 
programme Netherlands; year of report 2013 [in Dutch]. Bilthoven: National 
Institute for Public Health and the Environment (RIVM); 2013. RIVM rapport 
150202001/2013. 

28. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I: 
Increasing response rates tot postal questionnaires: systematic review. 

BMJ 2002, 324:1-9. 

29. Fishbein M, Ajzen I: Predicting and changing behavior: the reasoned action 
approach. Taylor and Francis Group: Psychological Press; 2010. 

30. Ajzen I: The theory of planned behaviour. Organ Behav Hum Decis Process 
1991,50:179-211. 

31 . Askelson NM, Campo S, Lowe JB, Smith S, Dennis LK, Andsager J: Using the 
theory of planned behavior to predict mothers ' intentions to vaccinate 
their daughters. J Sch Nurs 2010, 26:194-202. 

32. Norman P, Armitage CJ, Quigley C: The theory of planned behavior and 
binge drinking: assessing the impact of binge drinker prototypes. 
Addict Behav 2007, 32:1 753-1 768. 

33. Lemmens KPH, Abraham C, Hoekstra T, Ruiter RAC, De Kort WLAM, Brug J, 
Schaalma HP: Why don't young people volunteer to give blood? An 
investigation of the correlates of donation intentions among young 
nondonors. Transfusion 2005, 45:945-955. 



Harmsen et al. BMC Public Health 2013, 13:1219 
http://www.biomedcentral.eom/1471-2458/1 3/1219 



Page 10 of 10 



34. Clarke CE, McComas K: Seeking and processing influenza vaccine 
information: a study of health care workers at a large urban hospital. 

Health Commun 2012, 27:244-256. 

35. Griffin RJ, Neuwirth K, Dunwoody S, Giese J: Information sufficiency and 
risk communication. Media Psychol 2004, 6:23-61. 

36. Griffin RJ, Yang Z, ter Huurne E, Boerner F, Ortiz S, Dunwoody S: After the 
flood: anger, attribution, and the seeking of information. So' Commun 
2008,29:285-315. 

37. Kahlor L: An augmented risk information seeking model: the case of 
global warming. Media Psychol 2007, 10:414-435. 

38. van Lier A, Oomen P, de Hoogh P, Drijfhout I, Elsinghorst B, Kemmeren J, 
Conyn-van Spaenendonck M, de Melker H: Praeventis, the immunisation 
register of the Netherlands: a tool to evaluate the national immunisation 
programme. Euro Surveill 2012, 17:20153. 

39. CBS statistics Netherlands: Inkomensverdeling. http://statline.cbs.nl/StatWeb/ 
publication/?VW=T&DM=SLNL&PA=70957ned&Dl=a&D2=0&D3=0&D4=0&D5= 
0,54-68&D6=l&HD=080523-1734&HDR=G3,G2,Gl,G5,T&STB=G4. 

40. Cohen J: A power primer. Psychol Bull 1 992, 1 1 2:1 55-1 59. 

41. Freed GL, Clark SJ, Butchart AT, Singer DC, Davis IvlW: Sources and 
perceived credibility of vaccine-safety information for parents. 
Pediatrics 2011 , 127:107-112. 

42. Smith PJ, Kennedy AM, Wooten K, Gust DA, Pickering LK: Association 
between health care providers' influence on parents who have concerns 
about vaccine safety and vaccination coverage. Pediatrics 2006, 
118:1287-1292. 

43. Gust D, Weber D, Weintraub E, Kennedy A, Soud F, Burns A: Physicians who 
do and do not recommend children get all vaccinations. J Health 
Commun 2008, 13:573-582. 

44. Godin G, Kok G: The theory of planned behavior: a review of its 
applications to health-related behaviors. Am J Health Promot 1996, 
1 1 :87-98. 

45. Griffin RJ, Dunwoody S, Neuwirth K: Proposed model of the relationship of 
risk information seeking and processing to the development of 
preventive behaviors. Environ Res 1999, 80:230-245. 

46. Boot CRL, Meijman FJ: The public and the internet: multifaceted drives 
for seeking health information. Health Informatics J 2010, 16:145-156. 

47. Kata A: A postmodern Pandora's box: anti-vaccination misinformation on 
the internet. Vaccine 2010, 28:1709-1716. 

48. Wolfe RM, Sharp LK: Vaccination or immunization? The impact of search 
terms on the Internet. J Health Commun 2005, 10:537-551. 

49. Goritz AS, Crutzen R: Reminders in web-based data collection: increasing 
response at the price of retention? Am J Eval 2012, 33:240-250. 

50. CBS statistics Netherlands: Mobile internet use continues to grow. 
Press Release 201 2:PB1 2-060. 



doi:10.l 186/1471-2458-13-1219 

Cite this article as: Harmsen ef at: Parental information-seeking 
behaviour in childhood vaccinations. BMC Public Health 2013 13:1219. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at f \ n! _, ul _-| r Q r,tr=l 

www.biomedcentral.com/submit B,onne «« central 



V 



